Method for calculating an augmented reality (ar) display for displaying a navigation route on an ar display unit, device for carrying out the method, transportation vehicle and computer program

ABSTRACT

A method for calculating an AR overlay of additional information for a display on an AR display unit. The AR overlay is used for the representation of a navigation route on the AR display unit. The navigation route is specified by a navigation system. The AR overlay is calculated so that a symbol for a target object or a target person is overlaid on the next turn or on the horizon, the symbol being configured so that, besides the information about which target object or which target person is involved, a direction indicator is seen by the driver, in which direction the target object or the target person is to be found.

PRIORITY CLAIM

This patent application claims priority to German Patent Application No.10 2018 207 440.2, filed 14 May 2018, the disclosure of which isincorporated herein by reference in its entirety.

SUMMARY

Illustrative embodiments relate to the technical field of driverinformation systems, which are also known by the term infotainmentsystem. Such systems are used above all in transportation vehicles.There is, however, also the possibility of using the illustrativeembodiments for pedestrians, cyclists, etc. with data glasses.Illustrative embodiments further relate to a correspondingly configuredapparatus for carrying out the method, as well as to a transportationvehicle and a computer program.

BRIEF DESCRIPTION OF THE DRAWINGS

Exemplary embodiments are represented in the drawings and will beexplained in more detail below with the aid of the figures.

FIG. 1 shows the principle of the overlaying of information into thefield of view of the driver of a transportation vehicle while driving,with the aid of a head-up display;

FIG. 2 shows the typical passenger compartment of a transportationvehicle;

FIG. 3 shows a block diagram of the infotainment system of thetransportation vehicle;

FIG. 4 shows a flowchart of a program for calculating the various ARoverlays in the course of the disclosed method;

FIG. 5 shows a representation of an AR overlay for the driver on inputof a passenger request into a ride-sharing system;

FIG. 6 shows a representation of an AR overlay for the driver afteraccepting the ride-sharing of the person from whom the ride-sharingrequest comes;

FIG. 7 shows a representation of an AR overlay for the driver with anavigation representation for the case in which no ride-sharing requesthas been accepted;

FIG. 8 shows a representation of an AR overlay for the driver with anavigation representation for the case in which a ride-sharing requesthas been accepted;

FIG. 9 shows a representation of an AR overlay for the driver with anavigation representation for the case in which the ride-sharing personis already in the region of view of the driver;

FIG. 10 shows a representation of an AR overlay for the driver with twonavigation representations for the case in which the ride-sharing personhas just disappeared from the overlay region of the HUD display unit bycloser approach of the transportation vehicle;

FIG. 11 shows a representation of an alternative AR overlay for thedriver with a navigation representation for the case in which aride-sharing request has been accepted; and

FIG. 12 shows a representation of an AR overlay for the driver with anavigation representation for the case in which the driver has input aparticular point of his interest.

DETAILED DESCRIPTION

A future vision in the transportation vehicle industry is to be able toplay virtual elements on the windshield of a person's own transportationvehicle, to offer the driver some benefits. So-called “augmentedreality” (AR) technology is used. In this case, the real environment isenriched with virtual elements. This has several benefits: looking downon displays other than the windshield is avoided, since much relevantinformation is imaged on the windshield. The driver thus does not needto take his view off the road. The particular characteristic of ARrepresentations is that accurately positioned localization of thevirtual elements in the real environment is possible. The virtualelement is also overlaid at the position where the driver is directinghis view in the real environment. With these overlays, the realenvironment can be “superimposed” from the viewpoint of the user andprovided with additional information; for example, a navigation path maybe overlaid. In this way, less cognitive engagement by the driver isachieved, since no interpretation of an abstract graphic needs to becarried out; rather, intuitive understanding in the sense of normalperception habits may take place.

At present, head-up displays (HUDs) are being used as AR display unitsin transportation vehicles. These also have the benefit that the imageof the HUD appears closer to the real environment. These displays are infact projection units which project an image onto the windshield.However, depending on the design of the module, from the viewpoint ofthe driver this image is located from a few meters to 15 meters in frontof the transportation vehicle. This has the benefit that the overlaidinformation is presented in such a way that the driver's eyes arerelieved of accommodation activity.

The “image” is in this case formed in the following way: it is less avirtual display than rather a kind of “keyhole” into the virtual world.The virtual environment is theoretically placed over the real world, andcontains the virtual objects which assist and inform the driver whendriving. The limited display surface of the HUD has the result that anexcerpt thereof can be seen. A person thus looks through the displaysurface of the HUD at the excerpt of the virtual world. Since thisvirtual environment supplements the real environment, the term “mixedreality” is also used in this context.

At present, work is likewise intensively being carried out intotechnologies which in the future are intended to allow autonomousdriving. A first approach is in this case not to fully relieve thedriver of his tasks, but to ensure that the driver can take control ofthe transportation vehicle at any time. The driver furthermoreundertakes monitoring functions. By recent technologies in the field ofdriver information systems, such as a head-up display, it is possible toinform the driver better about what is happening in the environment ofhis transportation vehicle.

Because of the current development towards autonomy levels which arehigher, but in which many transportation vehicles are controlled by thedriver as before, it is to be assumed that corresponding additionalinformation will in the medium-term already be usable for manuallydriven transportation vehicles and not only in the long-term for highlyautomated systems. In this context, the solution described in moredetail below may be used for both manually controlled and forautomatically controlled transportation vehicles.

For the driver/transportation vehicle interaction, the question in thiscase arises of how this information may be represented in such a waythat genuine added value is provided for the human driver and he/she canalso rapidly, or intuitively, find the information provided. Thefollowing solutions in this field are in this context already known fromthe prior art.

Most transportation vehicles nowadays have a navigation system toprovide target and road guidance for a driver. Furthermore,transportation vehicles having an HUD mounted therein are available onthe market, the HUD rejecting design information and to the windshieldof a transportation vehicle and allowing the driver to observe theprojected information while the driver is looking forwards.

A system and a method for a ride-sharing service are known from US2016/0364823 A1. A method is disclosed therein, in which a carpoolingrequest is received by a driver. A computer formulates a carpoolingproposal, which is directed to the first and second users. A time for aspatially and temporally common carpooling demand is thereforedetermined.

A method and a system which are configured for obtaining an instructionwhich instructs a transport vehicle unit to transport a passenger isknown from US 2017/0308824 A1. In this case, in one operation theposition and the distance of the transport vehicle relative to a meetingpoint are determined and displayed.

A navigation instrument having a camera is known from WO 2006/132522 A1.

While conventional navigation displays (with the usual LCD displays)generally display schematic representations (for example, an arrowrunning at a right angle to the right as an indication that it isnecessary to turn right at the next opportunity), AR displays offersubstantially more effective possibilities. Since the indications can berepresented as “part of the environment”, extremely rapid and intuitiveinterpretations are possible for the user. Nevertheless, the previouslyknown approaches also have various problems, for which no solutions arecurrently known.

The navigation function inside a transportation vehicle will be assistedmore in the future by representations of a head-up display (augmented orwith 2D maneuver indications). To assist the user with constant road &route guiding, the system augments a navigation path directly onto theroad.

In other situations, however, additional information is also desired. Inthe scope of future mobility solutions, it is conceivable that thetransportation vehicle users will allow other persons to be carried intheir transportation vehicle. The mediation of this ride may take placeby a request of the passenger to the driver, for example, via asmartphone app. For the driver, the interactions entailed by this(request and agreement of a ride, adaptation of the navigation, pickupof the passenger) should ideally likewise be overlaid as additionalinformation. This should, however, be carried out with as littledistraction as possible.

There is therefore a need for further improvements in the route guidingof a transportation vehicle and the feedback to the driver in thisregard through the infotainment system.

The disclosed embodiments assist the driver better with route changes,particularly with a view to future mobility solutions.

The disclosed embodiments provide a method for calculating an “augmentedreality” overlay for the representation of a navigation route on an ARdisplay unit, an apparatus for carrying out the method, a transportationvehicle, and a computer program. In this case, the overlay serves thepurpose of assisting the driver with the longitudinal driving guiding ofthe transportation vehicle.

The method for calculating an AR overlay for the representation of anavigation route on an AR display unit according to the proposalconsists in calculating the AR overlay in such a way that the AR overlayis calculated in such a way that a symbol for a target object or atarget person is overlaid on the next turn or on the horizon, the symbolbeing configured in such a way that, besides the information about whichtarget object or which target person is involved, a direction indicatorcan be seen by the driver, in which direction the target object or thetarget person is to be found. The method is particularly beneficial tobe used for the new mobility solutions in the manner of a ride-sharingcenter. The carrying of other persons, especially the pickup anddropping off of the person, is facilitated for the driver. The methodmay also be used for other everyday circumstances, for example, when thedriver is looking for particular facilities, also known as points ofinterest POI.

At least one beneficial measure of the method is that, when approachingthe target object or the target person, the AR overlay for the symbol iscalculated in such a way that the symbol is overlaid on the location ofthe target object or the target person when the target object or thetarget person is in visual range, the direction indicator being directedon the ground in front of the target object or the target person. Thedriver thus receives specific assistance. His view is turned directly tothe target object or the target person. Prolonged searching for thetarget person unknown to him or the target object unknown to him isavoided, and the driver is distracted less.

It is furthermore beneficial that, when approaching closer to the targetobject and the target object or the target person therefore moves out ofthe overlay region of the AR display unit, the AR overlay for the symbolis calculated in such a way that the symbol is represented at the edgeof the overlay region, in such a way that the direction indicator isdirected towards the target object or the target person. The driver thusreceives further assistance even when the location of the target personor of the target object is reached. The target person can thus be pickedup quickly without disrupting the following traffic for a significantlength of time. This is beneficial at pickup locations in dense traffic,where there is little opportunity to stop.

The configuration may also be such that the AR overlay, when approachingcloser to the target object, for the symbol is calculated in such a waythat the symbol appears offset from the edge of the overlay region inthe direction of the middle of the road. In this case, the directionindicator indicates where the person is to be found. The informationthen lies more centrally in the field of view of the driver andindicates that the driver should stop.

It may furthermore be beneficial that the AR overlay for the symbol iscalculated in such a way that the symbol is enlarged when thetransportation vehicle approaches the target object or the targetperson. This corresponds to the natural experience that the targetobject or the target person also becomes larger when approaching.

It is beneficial that the symbol has a speech bubble shape in which animage or a pictogram of the target object or the target person isinserted in the middle of the symbol and the direction indicator isformed at the edge by rotating the speech bubble arrow. This speechbubble shape will be interpreted correctly by most people.

At least one beneficial measure is furthermore that the AR overlay forthe representation of the symbol is calculated in such a way that thename or another designation of the target object or the target person isoverlaid below the symbol.

It is furthermore beneficial that the AR overlay likewise comprises aspecification of distance to the target object or the target person,which is calculated in such a way that the distance specification isoverlaid next to the symbol. The driver is thereby informed moreaccurately.

For an apparatus for carrying out the disclosed method, it is beneficialthat the apparatus comprises an AR display unit, a computer unit and anavigation system. A navigation route is calculated by the navigationsystem, the navigation system being configured in such a way that itperiodically recalculates the navigation route to adapt to changingsituations, in particular, the traffic conditions. The computer unitcarries out the operations for calculating an AR overlay. In this case,the computer unit is configured for the calculation of an AR overlay ofthe type that a symbol for a target object or a target person isoverlaid at the next turn or on the horizon, the symbol being configuredin such a way that, besides the information about which target object orwhich target person is involved, a direction indicator can be seen bythe driver, in which direction the target object or the target person isto be found. As explained above in connection with the disclosed method,the solution is of interest for commercial mobility solutions in themanner of a ride-sharing center.

In this case, at least one disclosed embodiment is that the apparatus isequipped with environmental observation methods or mechanisms, with theaid of which recognition of the target person or of the target object iscarried out. To this end, one or more cameras may, for example, befitted to the device. Image recognition methods are used to evaluate theimages delivered by the camera. In this case, there are known algorithmswith which the image evaluation for the object or the person recognitioncan be carried out.

The apparatus is configured in such a way that, with the correspondinglyprogrammed computer unit, the calculations of AR overlays which areperformed in the corresponding method operations of the disclosed methodare carried out.

Moreover, the same benefits as mentioned in the claims with thecorresponding method operations apply for the apparatus for carrying outthe method with the correspondingly programmed computer unit.

It is beneficial that the display unit of the apparatus is configured asa head-up display. Instead of a head-up display, data glasses which thedriver wears, or a monitor on which a camera image, in which the ARoverlay is inserted, is displayed, may be used in the apparatus as adisplay unit.

As mentioned, the disclosure may also be used when the display unitcorresponds to data glasses. Then, the disclosed method may even be usedfor pedestrians, cyclists, motorcyclists, etc.

The apparatus for carrying out the method may be part of atransportation vehicle.

For a computer program which is run in the computer unit of theapparatus to carry out the disclosed method, the corresponding benefitas described for the disclosed method apply. The program may beconfigured as an app that is loaded into the apparatus by a downloadfrom a provider.

The present description illustrates the principles of the disclosure. Itis therefore to be understood that persons skilled in the art will beable to conceive of various arrangements which, although not explicitlydescribed here, embody principles of the disclosure and are likewiseintended to be protected in their scope.

FIG. 1 illustrates the basic functionality of a head-up display. Thehead-up display 20 is fitted in the transportation vehicle 10below/behind the instrument cluster in the dashboard region. Byprojection onto the windshield, additional information is overlaid intothe field of view of the driver. The additional information appears insuch a way as if it were projected onto a projection surface 21 at adistance of 7-15 m in front of the transportation vehicle 10. Throughthis projection surface 21, however, the real world remains visible.With the overlaid additional information, so to speak, a virtualenvironment is generated. The virtual environment is theoreticallyplaced over the real world and contains the virtual objects which assistand inform the driver when driving. However, projection is carried outonto only a part of the windshield, so that the additional informationcannot be arranged arbitrarily in the field of view of the driver.

FIG. 2 shows the passenger compartment of the transportation vehicle 10.A transportation vehicle is represented. However, any other desiredtransportation vehicles could also be envisioned as the transportationvehicle 10. Examples of further transportation vehicles are: coaches,commercial vehicles, in particular, trucks, agricultural machines,construction machines, rail vehicles, etc. Use of the disclosedembodiments would generally be possible for agricultural vehicles, railvehicles, watercraft and aircraft.

In the passenger compartment, three display units of an infotainmentsystem are highlighted with references. These are the head-up display 20and a touch-sensitive screen 30, which is fitted in the central console.During driving, the central console is not in the field of view of thedriver. For this reason, the additional information is not overlaid onthe display unit 30 during driving. Furthermore, the conventionalinstrument cluster 110 in the dashboard is shown.

The touch-sensitive screen 30 is in this case used, in particular, foroperating functions of the transportation vehicle 10. For example, aradio, a navigation system, playback of stored music tracks and/orair-conditioning, other electronic devices or other conveniencefunctions or applications of the transportation vehicle 10 may becontrolled thereby. In short, this is often referred to as an“infotainment system”. In transportation vehicles, especiallyautomobiles, an infotainment system refers to the combination ofautomobile radio, navigation system, hands-free device, driverassistance systems and further functions in a central operator controlunit. The term infotainment is a portmanteau word made up of the wordsinformation and entertainment. To operate the infotainment system, thetouch-sensitive screen 30 (“touchscreen”) is mainly used, this screen 30being readily visible and operable by a driver of the transportationvehicle 10, but also by a passenger of the transportation vehicle 10.Mechanical operating elements, for example, buttons, control knobs orcombinations thereof, for example, rotary push-buttons, may furthermorebe arranged in an input unit 50 below the screen 30. Typically,steering-wheel operation of parts of the infotainment system is alsopossible. This unit is not represented separately, but is regarded aspart of the input unit 50.

FIG. 3 schematically shows a block diagram of the infotainment system200 and, by way of example, some subsystems or applications of theinfotainment system. The operating apparatus comprises thetouch-sensitive display unit 30, a computer device 40, an input unit 50and a memory 60. The display unit 30 comprises both a display surfacefor displaying variable graphical information and an operator controlsurface (touch-sensitive layer) arranged above the display surface forinput of commands by a user.

The display unit 30 is connected by a data line 70 to the computerdevice 40. The data line may be configured according the to the LVDSstandard, corresponding to low-voltage differential signaling. Via thedata line 70, the display unit 30 receives control data for driving thedisplay surface of the touchscreen 30 from the computer device 40. Viathe data line 70, control data of the commands entered are alsotransmitted from the touchscreen 30 to the computer device 40. Referencenumber 50 denotes the input unit. Associated with it are the alreadymentioned operator control elements such as buttons, control knobs,sliders, or rotary push-buttons, with the aid of which the operatingperson can make entries via the menu guide. Entry is generallyunderstood as meaning selecting a chosen menu option, as well asmodifying a parameter, switching a function on and off, etc.

The memory device 60 is connected by a data line 80 to the computerdevice 40. Stored in the memory 60 is a pictogram list and/or symbollist with the pictograms and/or symbols for the possible overlays ofadditional information.

The further parts of the infotainment system, camera 150, radio 140,navigation instrument 130, telephone 120 and instrument cluster 110 areconnected by the data bus 100 to the apparatus for operating theinfotainment system. The high-speed option of the CAN bus according toISO standard 11898-2 may be envisioned as a data bus 100. As analternative, the use of a bus system based on ethernet technology, suchas BroadR-Reach, could, for example, also be envisioned. Bus systems inwhich the data transmission takes place via optical waveguides are alsousable. The MOST bus (Media Oriented System Transport) or the D2B bus(Domestic Digital Bus) will be mentioned as examples. It will also bementioned here that the camera 150 may be configured as a conventionalvideo camera. In this case, it takes 25 full images/s, which correspondsto the interlace recording mode of 50 fields/s. As an alternative, aspecial camera may be used, which takes a plurality of images/s toincrease the accuracy of the object recognition in the case of rapidlymoving objects. A plurality of cameras may be used for the environmentalobservation. Besides this, the already mentioned RADAR or LIDAR systemsmay also be used as a supplement or alternative, to carry out or enhancethe environmental observation. For wireless communication inwards andoutwards, the transportation vehicle 10 is equipped with a communicationmodule 160. This module is often also referred to as an on-board unit.It may be configured for mobile radio communication, for example,according to the LTE standard, corresponding to Long-Term Evolution. Itmay likewise be configured for WLAN communication, corresponding toWireless LAN whether for communication with instruments of the occupantsin the transportation vehicle or for vehicle-to-vehicle communication orfor vehicle-to-infrastructure communication, etc.

The disclosed method for calculating an AR overlay of additionalinformation for a display on an AR display unit 20 will be explained indetail below with the aid of an exemplary embodiment. In this case,other exemplary embodiments are also discussed.

For the further figures, it is the case that the same reference numbersdenote the same fields and symbols as explained in the description ofFIGS. 1 to 3.

The procedure of giving a ride to a passenger in a “ride-sharingservice” will be explained with the aid of a flowchart and a pluralityof depictions of AR overlays, which are overlaid during the procedure.

FIG. 4 shows the flowchart of a computer program 400 for calculating ARoverlays for the various phases during the initiation of the ride of apassenger and when picking up the passenger. The program 400 is run inthe computer unit 40. The program start is denoted by the referencenumber 402. In the query 104, a check is made as to whether a riderequest of a person has arrived. If not, the program ends immediately atoperation at 422. If a ride request has arrived, however, in operationat 406 an AR overlay with a symbol 310 and further additionalinformation is calculated and displayed. The display of the AR overlayis shown in FIG. 5. As further additional information, text, such as aquestion, with the name 330 of the requesting person is overlaid.Further additional information relates to the length of the detourrequired to pick the person up, the extra time needed for the pickup,and the fare which the person would pay if they were given a lift. Nextto this, there are also two response elements 320, which give the driveran operation possibility. By selecting the checkmark and pressing the OKbutton in the case of steering-wheel operation, the driver canconveniently accept the ride request. By selecting the cross andpressing the OK button in the case of steering-wheel operation, thedriver can conveniently decline the ride request. This is typicalinformation which is sent out by such ride-sharing services. Additionalinformation which comes from particular driver assistance systems, suchas a road sign detection system, is also overlaid underneath.

In modern transportation vehicles, a multifunction steering wheel MFSW,with which the infotainment system can be operated, is typicallyinstalled. The basic operation by the MFSW can be carried out with thefollowing buttons. An operating element is selected with the arrowbuttons, and the selected element is confirmed with the OK button(confirm button).

In the further course of the program, a query 408 is carried out. Inthis, a check is made as to whether the ride request has been accepted.If not, the program is ended in program operation at 422. If the requestwas accepted, in program operation at 410 the calculation of an ARoverlay in which the acceptance of the ride request is confirmed to thedriver is performed. An example of this AR overlay is shown in FIG. 6.This is a reduced form in which only the selection checkmark isdisplayed. In parallel therewith, a recalculation of the driving routeis carried out in the navigation system, the pickup location of thepassenger is calculated in as an intermediate target.

After this, the program changes to calculating AR overlays for thenavigation to the pickup location of the passenger. In program operationat 412, an AR overlay is calculated which, in addition to the usualnavigation instructions such as navigation path 360 and turninginstruction 370, comprises a symbol 310 which has a speech bubble shapeand points to the passenger. FIG. 7 shows an example of this overlay.There, the exemplary embodiment is selected in such a way that thespeech bubble shape is circular, the area being filled with an image ofthe passenger. This may be a miniature view of a photograph deliveredtogether with the ride request, which has been forwarded by the system.The AR overlay is calculated with the assistance of the navigationsystem 130 in such a way that, in the event of an imminent drivingmaneuver, the speech bubble arrow as a direction indicator 315 isrotated in the direction in which the transportation vehicle 10 mustmove according to the recalculated navigation path 370.

In comparison therewith, the elements which are represented in theconventional AR overlay during navigation of the transportation vehicleare shown in FIG. 8. The symbol 310 with the direction indicator 315 isaccordingly absent in this depiction.

Subsequently, in a query 414, a check is made as to whether thetransportation vehicle has already approached the pickup location tosuch an extent that the passenger is in the region of view. This checkmay be carried out by on-board method or mechanism. The position of thetransportation vehicle 10 is acquired continuously by the navigationsystem 130. By analyzing the position of the transportation vehicle 10,it is already possible to determine whether the pickup location is invisual range. In addition, the environmental observation method ormechanism, such as the camera 150, may be used to identify the pickuplocation or the passenger 340. As already mentioned, to this end imageevaluation algorithms, for example, a face recognition algorithm, may beused. If the passenger is not in the region of view, the programbranches back to operation at 412 and further navigation instructionsfor the navigation to the pickup location are calculated.

FIG. 9 shows an exemplary AR overlay for the situation in which thepassenger is in visual range. The symbol 310 is located directly at theposition of the identified person. This also has the purpose of beingable to locate the passenger better within a group of persons. Thespeech bubble arrow points downwards so long as the speech bubble ispositioned at the location of the passenger.

In program operation at 418, a check is made as to whether the approachhas already progressed to such an extent that the target person movesout of the overlay region 21 of the HUD display unit 20. If not, theprogram branches back to operation at 416.

If it has, in program operation at 420 the AR overlay is calculated insuch a way that, when approaching the pickup location, the speech bubbleleaves the position of the passenger and moves in the direction of themiddle of the lane, since otherwise it would lie outside the displayregion. The rotatable direction indicator 315, such as the speech bubblearrow, then no longer points downwards but is rotated in the directionof the passenger. With this overlay, the driver is also indirectly givenan indication that he should stop. This corresponds to the conventionalprocedure when a driver is being instructed by a person who is holding asignaling disk, such as police, firefighters, construction workers, etc.In that case as well, the disk is held in front of the transportationvehicle to the signal to the driver that he should stop. Shortly beforethe stop, the name 330 of the passenger is overlaid. This procedure isrepresented in FIG. 10. There, it is represented that the passenger 340has just disappeared from the overlay region 21, the direction indicator315 is rotated and the name 330 is overlaid. The program subsequentlyends in program operation at 422.

FIG. 11 shows yet another form of the representation of a navigationpath 360 with overlay of the symbol 310. In this case, the navigationpath is represented as a continuous band and, next to the symbol 310, adistance specification 350 is overlaid to inform the driver of how farit still is to the pickup location.

FIG. 12 shows a form of an AR overlay for the case in which a passengeris not intended to be picked up, but instead the driver has input as anintermediate target a point of his interest, corresponding to a point ofinterest POI. For the case as well, the symbol 310 is configured as aspeech bubble. Underneath, a designation 330 of the POI is also overlaidin text form. The use of the speech bubble as a symbol may thereforealso be applied to static objects. In this case as well, the speechbubble would be located directly over the POI as long as it is withinthe display region of the head-up display 20. When approaching closer,the described repositioning in the direction of the middle of the lanewould again be carried out.

All examples mentioned herein, as well as related wordings, are to beinterpreted without restriction to such mentioned examples. For example,it will be realized by persons skilled in the art that the block diagramrepresented here represents a conceptual view of an exemplary circuitarrangement. Similarly, it is to be understood that a representedflowchart, state transition diagram, pseudocode and the like representdifferent options of the representation of processes, which can bestored essentially in computer-readable media and can therefore becarried out by a computer or processor. The object mentioned in thepatent claims may expressly also be a person.

It should be understood that the proposed method and the associatedapparatuses may be implemented in various forms of hardware, software,firmware, special processors or a combination thereof. Specialprocessors may comprise application-specific integrated circuits(ASICs), a reduced instruction set computer (RISC) and/orfield-programmable gate arrays (FPGAs). Optionally, the proposed methodand the apparatus are implemented as a combination of hardware andsoftware. The software may be installed as an application program on aprogram memory apparatus. Typically, it is a machine based on a computerplatform which comprises hardware, for example, one or more centralprocessing units (CPU), a random-access memory (RAM) and one or moreinput/output (I/O) interface(s). An operating system is typicallyfurthermore installed on the computer platform. The various processesand functions which have been described here may be part of theapplication program or a part which is carried out by the operatingsystem.

The disclosure is not restricted to the exemplary embodiments describedhere. There is latitude for various adaptations and modifications whichthe person skilled in the art would take into consideration as alsobelonging to the disclosure on the basis of his technical knowledge.

The disclosed embodiments may be used whenever the field of view of adriver, an operating person or simply only a person with data glasses,may be enhanced with AR overlays.

LIST OF REFERENCES

-   10 transportation vehicle-   20 head-up display HUD-   21 virtual projection surface-   30 touch-sensitive display unit-   40 computer unit-   50 input unit-   60 memory unit-   70 data line to the display unit-   80 data line to the memory unit-   90 data line to the input unit-   100 data bus-   110 instrument cluster-   120 telephone-   130 navigation instrument-   140 radio-   150 camera-   160 communication module-   200 infotainment system-   310 symbol-   315 direction indicator-   320 response option-   330 designation-   340 target person-   350 distance specification-   360 navigation path-   370 turning instruction-   400 computer program-   402 various-   422 program operations

1. An apparatus for carrying out a method for calculating an AR overlay(augmented reality overlay) for the representation of a navigation routeon an AR display unit, wherein the navigation route is calculated by anavigation system, wherein the AR overlay is calculated so a symbol fora target object or a target person is overlaid on the next turn or onthe horizon, the symbol is configured so that, besides the informationabout which target object or which target person is involved, adirection indicator is seen by the driver, in which direction the targetobject or the target person is to be found, wherein the apparatuscomprises: an AR display unit corresponding to augmented realityoverlay; a navigation system by which a navigation route is calculated;and a computer unit for calculating an AR overlay, wherein the computerunit is configured for the calculation of an AR overlay where a symbolfor a target object or a target person is overlaid at the next turn oron the horizon, the symbol being configured so that a directionindicator is seen by the driver in which direction the target object orthe target person is to be found.
 2. The apparatus of claim 1, furthercomprising environmental observation means for aiding in recognizing thetarget person or the target object.
 3. The apparatus of claim 1, whereinthe computer unit is configured to carry out the calculations of ARoverlays for aiding in recognizing the target person or the targetobject.
 4. The apparatus of claim 1, wherein the display unit is ahead-up display (HUD) or data glasses.
 5. A transportation vehicle,comprising an apparatus for carrying out a method for calculating an ARoverlay (augmented reality overlay) for the representation of anavigation route on an AR display unit, wherein the navigation route iscalculated by a navigation system, wherein the AR overlay is calculatedso a symbol for a target object or a target person is overlaid on thenext turn or on the horizon, the symbol is configured so that, besidesthe information about which target object or which target person isinvolved, a direction indicator is seen by the driver, in whichdirection the target object or the target person is to be found, whereinthe apparatus comprises: an AR display unit corresponding to augmentedreality overlay; a navigation system by which a navigation route iscalculated; and a computer unit for calculating an AR overlay, whereinthe computer unit is configured for the calculation of an AR overlaywhere a symbol for a target object or a target person is overlaid at thenext turn or on the horizon, the symbol being configured so that adirection indicator is seen by the driver in which direction the targetobject or the target person is to be found.
 6. A computer program run ona computer unit, wherein the computer program is configured to carry outa method for calculating an AR overlay (augmented reality overlay) forthe representation of a navigation route on an AR display unit, whereinthe navigation route is calculated by a navigation system, wherein theAR overlay is calculated so a symbol for a target object or a targetperson is overlaid on the next turn or on the horizon, the symbol isconfigured so that, besides the information about which target object orwhich target person is involved, a direction indicator is seen by thedriver, in which direction the target object or the target person is tobe found.
 7. A method for calculating an AR overlay (augmented realityoverlay) for the representation of a navigation route on an AR displayunit, wherein the navigation route is calculated by a navigation system,wherein the AR overlay is calculated so a symbol for a target object ora target person is overlaid on the next turn or on the horizon, thesymbol is configured so that, besides the information about which targetobject or which target person is involved, a direction indicator is seenby the driver, in which direction the target object or the target personis to be found.
 8. The method of claim 7, wherein the AR overlay for thesymbol is calculated so that the symbol is overlaid on the location ofthe target object or the target person when the target object or thetarget person is in visual range when approaching the target object orthe target person, the direction indicator is directed on the ground infront of the target object or the target person.
 9. The method of claim7, wherein the AR overlay for the symbol is calculated so that thesymbol is represented at the edge of the overlay region when approachingcloser to the target object and the target object or the target personmoved out of the overlay region so that the direction indicator isdirected towards the target object or the target person.
 10. The methodof claim 9, wherein the AR overlay for the symbol is calculated so thatthe symbol appears offset from the edge of the overlay region in thedirection of the middle of the road when approaching closer to thetarget object.
 11. The method of claim 9, wherein the AR overlay for thesymbol is calculated so that the symbol is enlarged when thetransportation vehicle approaches the target object or the targetperson.
 12. The method of claim 7, wherein the symbol has a speechbubble shape in which an image or a pictogram of the target object orthe target person is inserted in the middle of the symbol and thedirection indicator is formed as a direction arrow at the edge.
 13. Themethod of claim 12, wherein the direction arrow is integrated as aspeech bubble arrow into the edge of the symbol.
 14. The method of claim7, wherein the AR overlay for the representation of the symbol iscalculated so that the name or another designation of the target objector the target person is overlaid below the symbol.
 15. The method ofclaim 12, wherein the AR overlay further comprises a specification ofdistance to the target object or the target person which is calculatedso that the distance specification is overlaid next to the symbol.